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(54) Electronic camera with "^utilization" selection capability 

(57) A digital camera includes a liquid crystal dis- 
play (LCD) for viewing images captured from an image 
sensor and stored on a removable memory card. The 
LCD also presents a user interface (Ul) that allows the 
user to create a print order "utilization file". As individual 
images are viewed, the user can decide how many (if 
any) prints to make of the image, the print size, and the 
print quality (low cost ink jet versus high quality thermal 
prints, for example). The memory card can then be 
inserted in a home printer, walk-up kiosk, or dropped 
off/mailed to a photof inisher, or the camera itself can be 
connected to the printer or kiosk via a wired or wireless 
(e.g.. IrDA) link. The print order can then be automati- 
cally produced without any additional user intervention. 
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Description 

CROSS-REFERENCE TO RELATED APPLICATiON{S) 

Reference is made to commonly assigned copending applications Serial Na 60/037.962, entitled "Network Config- 
uration RIe for Automatically Transmitting Images from an Electronic Still Camera" and filed on the same date herewith 
in the names of Joseph Ward, Kenneth A. ParulsW. and James D. Allen, and which is assigned to the assignee of this 
application. 

RELD OF THE INVENTION 

The invention relates generally to the field of photography, and in particular to electronic photography. More spedf- 
ically. the invention relates to a digital camera that can be interfaced with a host computer. 

BACKGROUND OF THE II^IVENTION 

Digrtal cameras, such as the Kodak Digital Science DC25™ camera, allow images to be utilized on a home com- 
puter (PC) and to be incorporated into e-mail documents and peraonal home pages on the Wbrld Wide Web. Presently. 
If a print is desired, each image must first be copied to the PC and then individually printed. The user is required to man- 
ually select each image to be printed, and manually decide how big each print should be and how many prints to make 
of each image. 

In addition, it is possible for users to electronically send images to others using software, such as the Kodak Digital 
Science Picture Postcard Software^^. However, this again requires the user to manually download each Image to the 
host computer, select each image to be transmitted, and create a new "Postcard" for each image to be sent Users can 
also create "albums" of photos on their computers using software such as the Family Album Creator™ by Creative Won- 
ders. Inc. Again, however, this is a manual process that requires each image to be downloaded to the corrputer indi- 
vidually selected, and added to the album. 

In U.S. Patent 5.241.659. reprint information can be generated at the time a PhotoCD disc is played back This pat- 
ent describes an EEPROM card that can be inserted into a PhotoCD player. As shown in Figs. 3. 5. and 6 of this patent 
the EEPROM card can contain reprint order information and "album disc" Information input by the player operator How- 
ever, this information is not generated at the time of picture taking, and is not stored on the same media as the images 
Moreover, the repnnt information does not include information useful to the service provider, such as user account 
charge card, nnailing address, etc. 

What is needed is a way for camera users to quickly and easily compose "print orders" and transmission orders" 
and/or electronic albuming" ordere, at tiie time they capture their images. 

SUMIMARY OF THE INVENTION 

The present invention is directed to overcoming one or more of the problems set fortii above. Briefly summarized 
according to one aspect of the present invention, ttie camera and system of our invention meets this need by allowing 
the user to select "downsfream" services at the time of capture, using the camera's LCD screen and user interlace The 
digital camera includes a liquid crystal display (LCD) for viewing images captured from a CCD sensor and stored on a 
removable memory card. The LCD also presents a user interface (Ul) that allows the user to create a print order "utili- 
zaton file". As individual images are viewed, the user can decide how many (if any) prints to make of the image the 
pnnt size, and the pnnt quality (low cost Inkjet versus high quality thermal prints, for exanple). The memory card can 
then be inserted in a home printer, walk-up kiosk, or dropped offAnailed to a photoffinisher. or the camera iteelf can be 
connected to tiie pnnter or kiosk via a wired or wireless (e,g.. IrDA) link. The print order can then be automatically pro- 
duced without any additional user intervention. 

Alternately, a modem in tiie camera or card reader can transmH the utilization file and the image data to a print serv- 
ice provider, which can produce tiie prints and return tiiem via mail to ttie user, or to a party designated by the user. TTie 
utilization file can alternately include e-mail addresses to allow images to be automatically sent to ottiers postal 
address information for sending print images, or albuming information to allow images to be placed in an on-line image 
oaTaoase. 

BRIEF DESCRIPTION OF THE DRAWINGS 



FIG. 1 is a block diagram of ttie system according to the invention. 

FIG. 2 is a diagram of downstream services available in ttie system shown in Rgure 1 . 



EP0860 980A2 



FIG. 3 is an illi^tration of one example of a creative background added to an image. 
FIG. 4 is a diagram of the organization of a utilization file. 

FIG. 5 is a diagram of another organization of a utilization file together with each image f ila 

5 DETAILED DESCRIPTION OF IHE INVENTION 

Because imaging systems and devices are well known, the present description will be directed in particular to ele- 
ments forming part of. or cooperating wore directly with, apparatus in accordance with the present invention. Elements 
not specifically shown or described herein may be selected from those known in the art Some aspects of the present 

10 desaiption may be implemented In software. Unless otherwise specified, all software implementation is conventional 
and within the ordinary skill in the programming arts. 

A system block diagram of the invention is shown in Rgure 1 . and includes a user's host computer(PC) 1 0. a digital 
camera 12. equipment located at a "downstream" service provider 14. and equipment at a walk-up kiosk 16. The cam- 
era 12 includes an optical section 18 for imaging a scene upon an image sensor 20 and generating an image signal, an 

IS A/D converter 22 for digitizing the image signal, a liquid crystal display (LCD screen) 24 for displaying images and other 
information, a number of user input buttons 26, and tx)th internal memory 32 and a removable memory card 36 for stor- 
ing captured images. The camera may qDtionally include an internal communications interface 28 (e.g. modem). A 
microprocessor 29 generally controls the operation of the camera 12, and interchanges data through a memory card 
interface 34 with the memory card 36. through a PC interface 38 with the host computer 10. through a host interface 30 

20 directly with the kiosk 16, and through the communications interface 28 and a communications network 31 with the 
service provider 14. 

When the camera is purchased, it is provided with a software application (located on a disc 40) for running on the 
user's host PC 10 that enables the user to specify the name(s) of downstream service providers, network addresses 
(friends, family or business associates) and related account information such as billing Information (charge card 

25 numt)er, mailing addresses, etc.). The user can also select, through the software application, one or more "creative 
backgrounds" offered by the service provider (such as a postcard border) and enter one or more text messages, (such 
as "Hi, I'm having a relaxing vacation, John Smith"), as will be described in connection with Figure 3. All of this informa- 
tion can then be downloaded, via a memory card reader 42 on the host PC 10, to the removable memory card 36, which 
can be subsequently inserted into the camera. Alternatively, the information can be downloaded to the camera 12 via 

30 the host PC interface 38 and written to the camera's internal memory 32 or the removable memory card 36 in ttie cam- 
era. Typically, keyword descriptors accompany the information to enable easy access by tiie camera user. 

After placing tiie memory card 36 in the camera (or disconnecting the camera from the host PC 10), tiie user can 
operate the camera 12 to take numerous pictures, which are stored either in the internal memory 32 or in the memory 
card 36 (or in both). After taking pictures, the user reviews the images on the LCD screen 24, using the buttons 26 to 

35 scroll through tine Images. The user can tiien select the desired "downstream services" (printing, e-mailing, and/or 
albuming) and compose the order using the options listed in Figure 2. These services and options are accessed from 
the memory card 36 and, for example, the keyword desaiptors are assembled in a menu and displayed on the LCD 
screen 24. Selections among these services and options are made, for example, by reference to the keyword descrip- 
tors and actuation of the user buttons 26. The details of the order information is written into a "utilization" file generated 

40 by tiie camera tiiat identifies the order and includes pointers to tiie image files that store the images required to luHiir 
the order. The "utilization" f ye is stored in the intemal memory 32 or tiie memory card 36. 

For printing, order composition involves selecting the quantity, pnnt size, and quality level (e.g.. thermal or ink jet) 
of tiie images to be printed. For exeunple, the user might choose one "standard" (4' x 6" size) image of 2 different 
images, and 2 standard size images plus one "enlargement" (8** x 10" size) image of their "favorite" vacation image. The 

45 print order information is provided in ttie utilization file that identifies the order and includes pointers to the image files 
that store the images required to "foffill" the print order. In addition to "normal" type prints, the prints can be "creative" 
prints, using one of the creative backgrounds selected on the host conrputer and downloaded to the camera along with 
text. In tiiis case, the "favorite" image might be sunrounded with one of the border and captions provided via the host 
PC 10, as shown in Figure 3. 

so The user can then take or mail the image memory card 36 containing the image files and order information (utiliza- 
tion file) to the print service provider 14. The provider reads the information, fills the print order. arKl returns the print 
order eitiier for pick-up by the user or by mail. The service provider 14 charges the users credit card account (which 
can be stored in the print order informatfon file) for the prints provided. Alternately, the user can place the card 36 in a 
slot 50 of a %valk-up kiosk" 16 along with a credit card. The kiosk can then automatically produce the prints required 

55 while minimizing the amount of user interaction required. Finally, the user could place the card in a home printer 48. and 
the printer could automatically produce the quantity of prints of each image required. In the last two cases, the size and 
quality of print types availat>le might be limited to those available by the kiosk 16 or the home printer 48. 

Alternately, the camera could incorporate or be connected to a wired or wireless modem, such as the communica- 
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tions interlace 28. In this case, the print order information, and the image information needed to fulfill the print order 
would be transmitted to the service provider 14 along with the account Infonnation through the communication networii 
31 (which could be a wired or wireless network). The service provider 14 would print the order and mail the prints back 
to the user. 

5 Instead of. orin addition to. composing a print order, the user may choose to transmit one or more images to others 
Those irrages can include the "creative" images and/or text described above. The user selects the images and the per- 
son(s) who will receive them, from the group of addresses toaded into the camera via the process described earlier (the 
software applicatnn running on the home PC 10). The e^1 order information is provided in the utilization file that 
gives the e-mail address and includes pointers to the image files that store the images required to Tulfiir the e^naH 

10 order. 

If the ramera includes a transmitter. e.g.. a cellular connection in the communications interface 28. the camera 
could include and initiate a "send" command that the user would enable after conyleting the e-mail order This com- 
mand would automatically send the appropriate images to the appropriate user's e^iT accounts through the network 
31 using the appropriate communications protocol (FTP. mailto. etc.). Alternately, the camera can be placed in a dock- 
!I? ^ containing the modem. The images can then be automatically transmitted to the service provider 

14. when the camera is inserted into the dock. Alternately, the memory card 36 could be removed from the camera and 
placed in a kiosK which would then transmit the images and bill the user's charge card. 

Instead of. or in addition to. composing a print order and/or an e-mal order, the user may choose to transmit one 
or more irtHges to their "electronic photo album" account which could be maintained by the service provider 14(or alter- 
^ "^^'^S^ maintained on fhe user's home computer 10) in an image "album" storage 52. In tWs case, the user 
selects the images to be transferred to their photo album, and optionally selects what group of users might be alfowed 
S,**®!! '^^ ""^^ P'"= immediate family only", and "All" (family, friends etc ) 

The information may include text, which may be input and selected as described in U.S. Patent No 5 633 678 "An Elec- 
tronic St.ll Camera for Capturing and Categorizing Images", filed December 20. 1995. and assigned to the a^gnee of 
25 the present application, and which is incorporated herein by reference. 

Instead of having ttie camera 12 communicaledirectly to the "downstream" service provider 14 over the communi- 
cations network 31, the communicattons nelworkSI from the camera 12 could alternately be connected to an intemet 
sennoe provider (ISP) (not shown) such as AOL (America On Une), Earthlink, Eznet. etc. The "downstream" sennce 
provider 14 would then be connected to all ISPs via the internet, eliminating the need to maintain a separate communi- 
cattons network. The ISP would transfer the utilization file data and images needed to order prints and album Images 
to the dowr^tream service provider. The ISP could itself handle e-maUing of images to other users, using the data and 
images in the utilization file. 

The utilization order infonnation Is provided in the utilization file. The general file organization is shown in Figure 4 
and a detailed example of the file contents of an elaborate utilization file is given in Appendix I. This file may be 
encrypted to prevent unauthorized use of the sensitive information, such as the user s aedit card nunOer Referring to 
Appendix I. a Global information section Oines 2-26) provides the customer information (name, address, credit card) as 
well as the time the order was placed, and whether rt has been processed or not. 

°' "^^ sections. Fbr example, lines 28-37 describe a print order of "standard" 
size (4 X 6") pnnis of the images made on a silver halide based CRT printer. Une 34 indicates that two copies of the 
iimge referenced in line 33 will be printed, while only one copy of the images referenced in lines 35-36 is printed A sec- 
ond pnnt order section (lines 39-55) indicates a large size print (24" x 36") should be made on a silver halide printer and 
mounted in particular in a vralnut frame. This printer shouW be sent via UPS to the address shown in lines 47-52 The 
image is the composite shown in Figure 3. which is described in the CreativeDetail section (lines 76-90) 

An e-mail order section (lines 57-65) provides the ennail address and a list of images that shouM be sent to this 
address. An abum order section (lines 67-72) provides a means for adding images to the users on-line photo album 
The user can dassrfy the images under a particular heading (e.g.. "vacation" images) and indicate who is allowed to 
access the images via the internet 

A Creative Detail section (lines 74-90) defines each creative image, such as the image in Rgure 3. It also describes 
user defined text (line 81). Multiple templates and user text options may be downloaded from the host conputer to a 
rnemory card that is then inserted into the camera, prior to taking pictures. The template (background) may be an iden- 
tification code that is only added, fbr example, during printing. In this case, the template is not viewed when the image 
K displ^ed on ttie camera. Alternately, a low resolution version of the tenplates desired by the user can be stored in 
ttie camera, so that the user can preiriew the final composite image A high resolution version of the tenplate can be 
usal by the service provider to print the final composite imaga The user may decide to crop and rotate the image (lines 
86-87) prior to inserting it into the creative background. naaevunes 
Rnally an image detail sectfon (92-102) describes the file type (e.g., FlashPix, JPEG. TIFF) and location of each 
image. In this example, the three images are all FlashPix images located on the memory card "Local Card" in the "vaca- 
tion folder. 
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Most of the information in Globallnfb and CreativeDetail sections of the digital canfiera utilization file, for example 
the addresses and creative text, is downloaded from the host computer to the camera prior to picture taking. After 
reviewing the images, the user uses the image LCD and user interface to select which images to pntii, e-mail, and 
album. The print size, e-mail, albuming, and creative options are offered by pull-down menus that match the options 

5 provided by the service providers they have selected on the computer and downloaded to the camera (via the card). 
TTie full utilization file (Print order, e-mail order, etc.) is then created by the camera based on the user selections. 

A much simpler print utilization fOe is shown in Appendix II. In this case, tiie camera simply allows a print order to 
be created. The memory card 36 containing the images and the simple utilization file is then inserted into the home PC 
10. the home printer, or the walk-up kiosk 16 or sent to a service provider via a communications interface. The proper 

10 number of each selected image is tiien automatically printed, without further user intervention. 

Instead of providing tiie utilization information for multiple images in a single utilization file, other embodiments are 
possible. For example, the camera may create three utilization ffles. one containing the information needed to produce 
a print order, a second containing information needed to provide electronic albuming. and a third containing e-mail order 
information. Alternately, tiie utilization information may be provided with each image file, as shown in Figure 5. In ttiis 

IS embodiment, the print order information desaibing the nunt)er and size of each image to be printed is included in tags 
provided within each image file. For example, image file #1 contains tiie image data and a tag indicating that the user 
has requested one standard size print. Image file #2 does not contain a print tag (or alternately could include a tag witii 
the number of prints set equal to zero) so no prints will be made of image #2. Image file #3 includes a first print tag indi- 
cating that tiie user has requested two standard size prints, and a second tag indicating tiiat the user has also 

20 requested a single 8" x 10" size enlargement. 

Other aspects of tiie invention include a digital printing system wherein the image utilization file includes the 
number of copies of at least one print, a digital printing system wherein the image utilization file includes the size of at 
least one print, a camera as wherein the image utilization data for the plurality of captured images is contained In a sin- 
gle utilization file, and a camera wherein the image utilization data for each of the plurality of captured images is con- 

25 tained within an image file. 

The invention has been described with reference to a preferred emtxxfiment. However, it will be appreciated that 
variations and modifications can be effected by a person of ordinary skill in the art without departing from the scope of 
the invention. 

30 



35 



40 



45 



SO 



55 



5 



EP0860 980A2 



APPKHDIX It DIGITAL CAMERA OTILIZATIOM PILE 

1 00000000 vriLIZATION ORDBt SPBCIFICATZON (NOn-zexo initial number identifies encryption 

key) 

2 tSection: GlobalZnfo 

3 %Sectlon: Constmerlnfo (Provides Info on eanera owner and default nailing address) 

4 tNaae: -'Staith'— John— W- 

5 %Consumer ID: NjjlOO? 

6 %Addre88: -1 Picture Avenue- 

7 -Apartment 8b- 

8 -PO BOX 123- 

9 -Anytonn- 

10 -State- 

11 %PO8talCode:-146S0- 

12 %CountryCode : USA 

13 %Einail: -jdoe9kodAk.com- 

14 %PhoneDay: -(716) 555-1111- 

15 %PhoneiKi9ht: -(716) 555-2222- 

16 %CreditCardBxpDate: 1996 03 24 

17 %CreditCardlluiiiber: 303044S643345 
IB %CreditCardType: AmericanBiqpress 
19 %EndSection: Consunerlnfo 

20 

21 %Section: Orderlnfo {Provides infozination on when utilization file was created) 

22 %Oate: 1996 2 28 

23 %Tlme: 14 22 29 

24 %Processed: 0 (1 indicates that this utilization order was processed) 

25 %BndSection: Orderlnfo 

26 %EndSection: Globallnfo 
27 

28 %Section: PrintOrder (Lists the images in a print order) 

29 %Section: Finishlnfo 

30 %IinageOutputSize: 4 6 Inches (This example is for standard size prints) 

31 %HediaClass; AgX 20 W34 Glossy 

32 %EndSection: Finishlnfo 

33 llmageRef ; imageDetaill (Points to images defined below) 

34 %Quantity:2 (Optionally indicates number of copies, default=l) 

35 tlmageRef: ImageDetail2 

36 %ImageRef: Image0etail3 

37 %EndSection: PrintOrder 
38 

39 %Section: PrintOrder 

40 %Section: Finishlnfo 

^1 %ImageOutputSize: 24 36 Inches (This example Is for a large creative print) 

42 %MediaCla8s: AgX 20 EN34 Glossy 

43 %FraaeType: P134 Walnut 

44 %BndSection: Finishlnfo 

45 %Section: Shipping Info (Instructions to ship to an address other than the one in 

Globallnfo) 

46 %ShippingCarrier : UPS 

47 %Naine: -Good — Johnny — B- 

48 %Address: -1 song Street- 
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49 -Ifytown- 

50 -State* 

51 %PostalCodo: -OOlll- 

52 tCountryCode: USA 

53 %BidSectlon: Shippinglnfo 

54 %I]aageRe£: CreativeOetaill (Points to creative defined below) 

55 tBodSection: PrintOrder 
56 

57 %Section: anailOrder (Sends images via e-mail) 

58 %Section: Addresslnfo (Instructions to ship to an address other than the one in 
GloballnCo) 

59 %Mame: -Good — Jolinny — B- 

60 %Bnail: -jgoodSlocalnet.net* 

61 %BndSoction: Addresslnfo 

62 %ImageRef : Creative Detain (Points to creative defined below) 
20 63 %ImageRef: ImageDetail2 

64 %ImageRe£: ImageDetailS 

65 %EndSection: E&iailOrder 
66 

67 %Section: AlbumOrder (Add these images to on-line photo album) 

68 %AlbumHeadiDg: -Vacation images- (Place images under * vacation* album heading) 

69 %AlbumViewing: All (gives access to all authorized album viewers) 

70 %lmageRef : CreativeDetaill (Points to creative defined below) 

71 %ImageRef: InageDetall2 

72 %EndSection: AlbumOrder 
73 

74 %Section: CreativeDetail 1 (Describes each composite image) 
75 

40 76 %IiayoutRef : T12345 (Indicates template ID or tenqplate image file) 

77 %Section: Fagelnfo 

78 %PageRef: 0 

79 %Section: Textlnfo (Indicates what text appears in the template) 
GO %TextHodeRef : 1 

81 %ConsumerText : -Hi, I'm having a relaxing time on vacation. John Smith 

82 %End5ection: Textlnfo 

83 %Section:lmageInfo (Indicates which images (s) appear in template) 

84 %imageNodeRef : 2 

55 * 
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%Iiiiagel>etailRef : 1 

®^ %CropRect: 256 0 768 1280 (Cropped linage top, left, width, height) 

®^ %Rotate: 90 (Indicates rotation in degrees clockwise) 

SB %EndSection: Zmagelnfo 

89 %findSectlon: PageZnfo 

90 %EndSection! Great IveDetail 
91 

92 %Section: InwgeData (Describes each image, may be referenced multiple times) 
%Section: IroageDetail 1 

%FlleType: FlashPix Version 2.0 
%ImageLocation: LocalCard-Vacation/Iiaage4 .FPX- 
%Section: ImageDetail 2 

%FileType: FlashPix Version 2.0 
^® * ImageLocation : LocalCard-Vacation/ Image? . FPX- 

99 %Section: ImageDetail 3 

%FileType: FlashPix Version 2.0 
%ImageLocation: LocalCard-Vacation/ ImagelO.FPx- 
102 %EndSection: ImageData 



APPENDIX II ; SIMPLE PRIMT ORDER UTILIZATION FILE 

1 %Sectlons PrintOrder (Lists the images in a print order) 

2 Iinage4.FPX 1 (one copy of image 4) 

3 Image7.FPX 2 (Two copies of image 7) 

4 ImagelO.FPX 1 

5 Imagel2 . FPX 4 

6 Imagel3 . FPX l 

7 %EndSection: PrintOrder 
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An elec^onic still camera for capturing images that can be downloaded to a utilization sendee provider for utiliza- 
tion, said camera comprising: 
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a sensor for capturing images: 
a memory for storing the captured images; 
means for displaying the captured images; 
a user interlace for selecting captured images to be utilized; 
5 means for generating an image utilization ffle; and 

means for storing the image utilization file along with the Images In said memory and conveying this information 
to a utilization service provider. 

2. The camera as claimed in claim 1 wherein utilization includes providing prints of the selected images in various 
10 sizes, quantities, and/or quality levels. 

3. The camera as claimed in claim 1 wherein utilization includes providing the selected images to selected e-mail 
accounts. 

15 4. The camera as claimed in daim 1 wherein utilization includes providing the selected images to an image database 
server. 

5. The camera as claimed in claim 1 wherein the utilization information includes a user account number, charge card 
number, and/or mailing address. 

20 

6. The camera as claimed in claim 1 wherein the utilization information for at least one image includes a text string 
and/or a creative background. 

7. The camera as claimed in claim 1 wherein the images and Image utilization file are stored in the same removable 
25 memory. 

8. A digital printing system comprising : 

means for producing hardcopy prints of digital images; 
30 means for reading image files from a digital memory device; 

means for reading an image utilization file from said digital memory device: and 

means for automatically controlling tiie hardcopy print means to produce the image order according to the 
information contained in said Image utilization file. 

35 9. The digital printing system as claimed in daim 8 wherein the image utilization file Includes at least one of a user 
account number, charge card nurrter and mailing address. 

10. An electronic still camera for capturing images that can be downloaded for printing, said camera comprising: 

40 a sensor for capturing images: 

a memory for storing the captured images; 

a user interface for selecting a plurality of captured Images to be printed; 

means for generating image utilization data for printing a plurality of captured images; and 

means tor storing the image utilization data and the plurality of captured images in said memory. 
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— GLOBAL INFORMATION — 
(CUSTOMER NAME, ADDRESS, BILLING INFO. ORDER DATE) 

— PRINT ORDER INFO — 

(SIZE, NUMBER OF COPIES. IMAGE REFERENCES) 

— E-MAIL ORDER INFO — 
(E-MAIL ADDRESS, IMAGE REFERENCES) 

— ALBUM ORDER INFO — 
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